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Abstract 



^ f We introduce a mean field spin glass model with gaussian distribuited 

spins and pairwise interactions, whose couplings are drawn randomly 
from a gaussian distribution A/'(0, 1) too. We completely control the 
main thermodynamical properties of the model (free energy, phase di- 
agram, fluctuations theory) in the whole phase space. In particular we 
prove that in thermodynamic limit the free energy equals its replica 

■ symmetric expression. 

>: 

^ ■ Introduction 
O 

■ Recently, some work has been done studying the properties of bipartite spin 

■ glasses [3] [2] H] • The main interest in these models is related to the peculiarity 
of the Hopfield Model, a well known model of very hard solution from a 
mathematical point of view (see |21) and references therein) , can be seen as 
a special bipartite model, with a party of usual dichotomic spin, and another 
party of special gaussian soft spin variables. 

;h \ In particular, from the investigation of dichotomic bipartite spin glasses, it 

^ ■ has been shown that, at least to the Replica Symmetric approssimation (with 

zero external field) , the model can be written as a convex combination of two 
different Sherrington-Kirkpatrick models, at different temperatures jjj. This 
seems to be more than a hint that a similar structure should be conserved in 
the Hopfield Model, and infact we have recently shown that this is the case 
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As a consequence, while the dichotomic spin glass has been intensively stud- 
ied, the need for a clear picture of its gaussian counterpart is the main interest 
for this paper. 

The Gaussian Spin Model has been originally introduced together with the 
Spherical Model in [6j. Then, due to the natural divergences arising in 
such a model, the main interest has been concentrated in the Spherical 
one [17] [8] [20] [18] [21], tought in some recent papers are discussed interesting 
properties of gaussian models similar to the one we introduce here for the 
first time [5][7|[10]. 

Therefore in our work we extend here techniques previously developed for 
pairwise dichotomic spin glasses to their gaussian counterparts. 
In Section 1 we introduce the model with all its related statistical mechanics 
package and regularize it so to avoid divergencies due to coupled fat tails of 
the soft (unbounded) spin. 

In Section 2, we show how to get a rigorous control of the thermodynamic 
limit of the free energy. 

Section 3 is left for the investigation of the high temperature limit (the 
ergodic behavior). 

In Section 4 we develop a generalization of a sum rule for the free energy 
in terms of its replica symmetric approximation and an error term. The 
breaking of ergodicity is expected to be a critical phenomenon. 
Section 5 is dedicated to a fluctuation theory for the order parameter. 
In Section 6 we develop the broken replica symmetric bound, coupled with 
the Parisi-like equation, and we show that it is equivalent to the bound given 
by replica symmetric solution. 

In Section 7 we finally prove a lower bound for the free energy, stating that 
the correct solution is the RS expression. 

1 Definition of the ]\/Iodel 

We introduce a system on N sites, whose generic configuration is defined 
by spin variables Zi G R, i = 1,2,...,N attached on each site. We call the 
external quenched disorder a set of A^^ indipendent and identical distributed 
random variables Jij, defined for each couple of sites (i, j). We assume each 
Jij to be a centered unit Gaussian M{0, 1) i.e. 

E(J,,-) = 0, E(4) = 1. 
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The interaction among spins is given by defining the Hamiltonian 

^ AT N 

Hn{z,J) = --j=='Y^JijZiZj -h'^Zi. 

The first sum, extending to all spin couples, with the factor is the 

typical long range spin-spin interaction of the mean field spin glass model. 
The second sum, extending to all sites, is the one-body interaction with a 
scalar external field /i G M. All the thermodynamic properties of the model 
are codified in the partition function that we write symbolically as 

configurations 

for a given inverse temperature (3. In our model we state that there are 
a number of identical z-type configurations proportional to dn{z), where 
dfj,{z) = dfi{zi)...dfj,{zN), dfi{zi) = (27r)~ 2 exp(— so to justify the 
following definition 

ZnW,J) = J dn{z)e-^"''^''-^^ =E,e-^^'''-'"^\ (1) 

Substantially, we called this kind of model "fully gaussian spin glass" because 
the external quenched disorder as well as the value of the soft-spin variables 
are drawn from a Gaussian distribution A^(0, 1). As early pointed out for 
instance in |6j, unfortunately these kind of models need to be regularized; in 
fact, the right side of is not always well defined as the pairwise interaction 
bridges soft spins which are both Gaussian distributed. 
It will be clear soon that a good definition is 

Zn{/3, J, A) = exp [ - pH^iz, J) - ^')' + 2 E ' (2) 

i=l i=l 

where the first additional term is needed for convergence of the integral over 
the Gaussian measure fj,{z) as it essentially fiattens the Gaussian tails of the 
variables Zj. The new parameter A, within the last term of ([2|), instead is 
inserted just to modify the variance of the soft spins, as in several applications 
this can sensibly vary. 

For a given inverse temperature (or noise level) /3, we introduce the (quenched 
average of the) free energy per site /Ar(/3), the Boltzmann state coj and the 
auxiliary function ^Ar(/3) (namely the pressure), according to the definition 

- f3fN{/3) = An^ = N-'ElogZN{fi,J), (3) 
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uj{0) = Z^iE,0(z) exp [ - (3H^{z, ^) " zff + -J^ 4] > (4) 

i=l i=l 

where O is a generic function of the z's. In the notation tjj, we have stressed 
the dependence of the Bohzmann state on the external noise J, but, of 
course, there is also a dependence on and A^. 

Let us now introduce the important concept of replicas. Consider a generic 
number s of independent copies of the system, characterized by the spin 
variables z^"^ , . . . zf"^ distributed according to the product state 

nj = jp ...uf, (5) 

where all Wj"'' act on each one ^;f"^'s, and are subject to the same sample J 
of the external noise. Finally, for a generic smooth function F{z^\ . . . z\^^) 
of the replicated spin variables, we define the (.) average as 

(F(zf),....f)))=Ef]Xi^(zf),...zf))). (6) 

Correlation functions are also well defined as overlap q between replicas: 

^ \ " a b 

qab,N = / .ZjZi- 

i=l 

Note that, once defined the overlap among replicas we can write 
Z^{(3, A, J) = E, exp (-I^MjCiz) - + ^ E ' 

V 1=1 1=1 J 

where IC{z) is a family of centered gaussian random variables with covari- 

ances Szz' = E[/C(z)/C(z')] = q^^, and the regularization term is just ^^-^q^^ = 

1 I3^N c 

2 Thermodynamic Limit 

The aim of this section is to show how to get a rigorous control of the infinite 
volume limit of the free energy fj\f (or similarly A^). The main idea, inspired 
by |14] . is to compare Ai\[, Ai\[-^ and jdjVj , with = For this purpose 

we consider both the original site system and two independent subsystems 
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made of by A^i and soft spins respectively, so to define 



i,j=l i=l 



2\2 



exp 



/3/iJ]z,)exp('^^zA ^ 



V 2 

i=l / \ i=l 



with < t < 1. The partition function Zj\[{t) interpolates between the 
original N-spin model (obtained for t = 1) and the two subsystems (of sizes 
A^i and obtained for t = 0) equipped with independent noises J' and J" , 
both independent of J, i.e. 

Zn{1) = ZNW,J,h) (9) 

Zn{o) = ZNAf3,j',h)ZN,{fi,j",h). (10) 

As a consequence, if we define the interpolating function 

ifit) = ^Elog ZN{t), (11) 
taking into account the definition ([3D, we have 
ip{l) = ANi(3,h), 

m = ^Ar,A(^,h) + ^Ar,,{f3,h). (12) 
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If we derive (p{t) we obtain 



N 



N 



\ ^ i=l / \ ^ j=iVi+l / 

with ujti-) and the (.) average as defined in ([3]) ([6]) but corresponding to the 
Boltzmannfaktor coupled to Zfyf{t) . 

Let us now evaluate for example the first term: using a standard integration 
by parts on the external noise (Wick's theorem) we obtain 

1 [ /3 ^ \ j3 ^ f d \ 

and then we get 

N 



/5 



( d \ 



i,j=l i,j=l 

The other terms of (|13p can be evaluated in the same way, therefore 

j^nt) = \{<1i2,n) - (9i2,iVi) - {Qi2,N2} J > (15) 
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where we defined the overlaps 

N- 



1 "1 

1_ V- Jl) J2) 



^ i=l 

.12,^. = ^ (16) 
Since qi2,N is a convex hnear combination of g'i2,Ari and 912,^2 > 

912, AT = —qi2,Ni + -^gi2,Af2) l^'j 

and due to the convexity of the function — )• x^, we have the inequahty 

2 A^i 2 N2 2 \ /X 

Ql2,N - ^9l2,7Vi - ^9l2,7V2 ) < 0. (18) 

A combination of the informations in (|15|) and (|18|) ahows us to state the 
foUowing result. 

Lemma 1. The interpolating function is increasing in t i.e. ^^{t) > 0. 
By integrating in t we get 

ifil) = 95(0) + J^^{t)dt > m (19) 

and recalling the boundary conditions ( I12p we obtain the main result 

Theorem 1. The following superadditivity property holds 

NAN{f3,h) > NiANAf^,h)+N2AN,{l3,h). (20) 

The superadditivity property gives an immediate control of the thermody- 
namic limit 1191. and we can state the next 



Theorem 2. The thermodynamic limit for A]\;(P,h) exists and equals its 
sup i.e. 

lim AN{/3,h) = A{f3,h) = sup AN{P,h). (21) 
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3 High Temperature behavior 

We start to analyze our model characterizing the high temperature regime 
at zero external field. First we define the annealed free energy of the model 

-/3/^(/3,A) =<(/3,A) = ^logEZ^(/3,A, J), (22) 
that can be easily computed as in the following 

Proposition 1. For A < 1 the annealed free energy of the model in the 
thermodynamic limit is well defined and coincides with 

- /3f^{/3, A) = hm A^{/3, A) = - J log(l - A). (23) 

Proof. 

^jZn = EjE.exp -^^J,,-z,z,--^(^z2)2 + -^ 

/ «2 ^ X ^ \ 

= E.exp -^(J]z2)2 + ^^2 E^exp 



\ i=l 1=1 / 

\ i=l i=l / 




E.exp (^^E^*') 



AT 



= (1-A)-- (24) 
Thus (|23p follows from (|22p and the proposition is proven. □ 



We define the high temperature regime as the region in the (/3, A) plane 
where the quenched free energy is equal to the annealed one. We already 
know that the annealed approximation is an upper bound for the pressure, 
infact a simple application of the Jensen inequality shows that 

i^Elog Zn{P, ^ ^ log ^' = A)- (25) 

On the other side we have that 

^ElogZ^(/3,A; J) > ^ElogZ^(/3,A; J), (26) 
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where Z'^{j3, A; J) is an auxiliary partition function in which diagonal terms 
of the spin-spin interaction are neglected, i.e. 



Z'^{(3,X;J) = E.exp --=^J,,z,z,-i^(J]zf)2 + -^ 

y ^ iT^j i=l i=l 



/^^ /V^ .,2^2 , ^ .,2 



y i<j i=i i=i 



where we have noted that -^[Jij + Jji) is a centered gaussian random variable 

M{0, 1) that we have simply denoted by Jij. Inequality (f26l) follows by an 
other application of the Jensen inequality on the Ja noises: 

ElogZw(/3,A; J) = Ej^^.Ej^^ log Z^(/3, A; Jij,Jn) 

> Ej^AogZNi(3,X;Jij,Ej^AJn]) 

= Ej,JogZAr(/3,A; J,,-,0) =ElogZ^(/3,A; J), 

Note that the auxiliary partition function Z'j^ gives the same annealed ap- 
proximation of Ztv; infact we have the following 

Proposition 2. For A < 1, 

hm llogEjZ^(/3,A;J) = -^log(l-A) = ^^(/3,A) (27) 



Proof. 

EjZ'j^ = EjE,, 



E, 



P 2.2 , A - 



i<j 



\ i=l i=l / \ * i<7 



i=l 1=1 / \ i<j 











AT 


■ Jij^iZj 


i<j 


2 2 









E.exp -^z2_ Y-^, 



i=l i=l 



(l-Arf (28) 
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Now, putting I3\ = jzrx, we notice that the function in the integral 



/ 



approaches to 1 uniformly for < A < 1 when N grows to infinity, and so 
the integral, that completes the proof. □ 

Now, we can control the high temperature region of Z'j^ studying the fluc- 
tuations of the random variable Z'j^ /E-Z^^ in according to the Borel-Cantelli 
lemma approach P]|21|. The following lemma holds: 

Lemma 2. For f3x = < 1 we have 

lim sup a/y x < / • (30) 



Before proving lemma [2] we note that it is a sufficient condition to state the 
following 

Lemma 3. In the region of the A) plane defined by < 1, i.e. /3 < 1 — A. 
lim ^ElogZ'^{^,X;J) = lim 1 logEZ^(/3, A; J) = A) (31) 

Thanks to inequalities (j25p and (|26p . we have proven the following main 

Theorem 3. The quenched free energy of the Gaussian spin glass model at 
zero external field does coincide with the annealed one 

-/3/(/3,A)= lim lElogZ^(/3,A;J) = -ilog(l-A) (32) 

Af— s>oo iV Z 

in the region of the (/?, A) plane defined by f3 < 1 — X. 
Now we attack Lemma [2j 

Proof. At first we evaluate E(Z^). By a straightforward calculation we have 

\ 1=1 i=i J 

where we neglected a term e ^i^i < 1. We can linearize the over- 

lap term introducing an auxiliary J\f{0, 1) gaussian random variable g so 
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e 2 = KgC^^^'^^'^^ . In this way the average factorizes on i so, bearing in 
mind (I28p and the overlap's definition, we can write 



s N 



TV 



/3f 



(33) 



where we used the simpler notation x = y = z{ \ Now it is sufficient 
to note that 



„4 I „2„2 



27r 



< E,e-^"*+wf'"'Ej,e-S?/\ 



since the function Ey[e is concave in a, and it exhibits a unique 

maximum in a = 0, as it can be easily verified. Hence we finally get 



^<E 
E2(Z^) - 



r -^e 



2 e 2]v e ^-'v 



da; 



e 2 e 4iv 



(34) 



and we can split this integral as a sum over the complementary regions 
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{g^ < N/Pl) and {g'^ > N/^l}. For the first one, we see that 



hm 

N^oo 



dg 



1 



g''<N/i3l V2tt 
dg 



e 2 



r -^e 



,2 /32,2g2 



,2.4 



2 e 2JV e 4-'^ 



2^4 



-^e 2 e 4JV 

V 27r 



hm 



2 V27r 



2-^ 



Pi 



N 



r dx_ 

J 2-K 



27r 



./2 



< hm 

Ar^oo7^2<jv//32 \/27r 

1 



do 9^ 



JV 
" 2 



< 



1-/3! 



(35) 



For the second one, we cannot perform the change of variable for the variance 
of the gaussian, and we have to estimate the integrals. As we have seen, the 
integral in the denominator is given by (|29p . Thus we can rewrite the second 
term as 



L 



dg 



2 Pix^g^ 



e 2 e 2]v e 



,_2.-iV 



dx _^ 

= e 2 e 



and notice that the function at the numerator in the integral is concave in 
and it assumes the unique maximum point at 5^ = 0, where it attains 
the same value of the denominator. Therefore we get the super-exponential 
decay of the gaussian tails: 



9^>N/i3l v2vr 



dq 9^ 
-.e~~ 



-^'/^F^{g,(3,) 



r dx 



< V2P{g^>N/Pl)^C\ 



2-K 

0" 



e 2 e 4iv 



JV 

Ac ^ 



for a certain constant C, and the lemma is proven. 



(36) 
□ 
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4 Sum Rules for the Free Energy 



In this section we introduce the repHca symmetric approximation for the 
free energy density. In particular, we obtain it as an upper bound for —f3f 
togheter with the error, in the form of a sum rule. For this purpose, we apply 
a well known interpolation scheme |11][9][T] [2] to compare the original two- 
body interaction with a one-body interaction system. Concretely, we define, 
for t G [0, 1] and g > C0, the interpolating partition function 

ZN{t, J, J') = exp [f^y^Y^ JijZiZj - t^iYl zf? 

i,j=l i=l 



N ^ \ 

i=l 2=1 / 



exp -Vzf , (37) 




where the external noise J'- are i.i.d Gaussian random variable J\f{0, 1) and 
they are also independent from all Jij. Here c is an additional lagrangian 
multiplier to be fixed later. Now we introduce the interpolating function 

^r^{t) = ^ElogZN{t,J,J'), (38) 

where we encode in E the averages respect to both J and J'. At t = 1 the 
interpolating function (|38p recovers the original system, while at i = it 
accounts for a simpler factorized one-body model and we can easily get 



Ej, logE^ exp ( (3^j'g + ^^^5' 



Ej, log(l- A-c)-5Egexp ( , J'g] 

\{l-X-c)2 ) 

log(a) + iEj,/32ga2j'2 = log(a) + \fiH<y\ (39) 



^despite it will be transparent at the end of the section, it may result helpful to bear 
in mind that q will act as the replica symmetric approximation of the overlap. 
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with a = {1 — X — c) 2 and where g as usual is a AA(0, 1) random variable. 
Therefore <pN{t) fulfills the following boundary conditions: 

ipNiO) = log(a) + ^/32gV. (40) 

Now we have to evaluate the t— derivative of ipN{t) in order to obtain the 
sum rule 

d 

^N{l)=fN{0)+ dt-^Nit). (41) 
Jo dt 

Using the notation (.)^ = '&Vtt{.), where ^t{-) is the replicated Boltzmann 
state encoded in the partition function (j37p . we can write 



* i,j=l \ i=l 



. n N N 

^i7=EE^;-(^.)-^i:«>,^ (42) 

i=l 



i=l 



A standard integration by parts over the external noise, as in (jl4p . shows 
that 



i,j=l \ i=l 



^ 1=1 i=i 



zf),- (43) 



Inserting (j43|) into (j42|) . we get 



J,^N{t) = + + ^ ^(-/3^,- - c) (..^>, , (44) 

i=l 

hence, adding and subtracting a term ^q"^ and with the choice c = — /3^g, 
we finally obtain 

We have just proved the following 
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Theorem 4. For every q G 'Dp^\{q) = G IR+ : 1 — A + fi'^q > O} is defined 
i(/3, A, q) = log(a) + \p^qa^ + (46) 

with a = (1 — A + I3'^q)~2 . Then, VA^ and Vg E T^i3,x{q), the quenched free 
energy of the mean field gaussian spin glass model defined in ([2]) fulfills the 
sum rule 

AN{f3, A) = -/3/jv(/3, A) = i(/3, A, q) - ^ j^' dt {{qu - qf), . (47) 

Moreover, \/q G T)p^x{q), A{/3,X,q) is an upper bound for A {13, X) uniformly 
in N, i.e. 

An{(3, A) = -/3/7v(/3, A) < i(/3, A, q). (48) 



Since the bound (I48p is uniform in A^, then it is true also in the thermo- 
dynamic hmit. The error term in (I47p reduces to the overlap's fluctuations 
around q. We can minimize this error, or equivalently optimize the estimate 
in ()48p . by taking the value of q that minimize A{/3,X,q). For this purpose 
we state the following 

Proposition 3. We have 

^A{P,X,q)=0 ^ q = or q = ^ ~ ^\ 



The solution q = is a minimum for f3x < 1, i.e. /3 < 1 — X). Conversely, 
for P > 1 — X the minimum is q = ^^^^7^. 

Proof. Since Oqa = —^a we have that 



^^(/3,A,,) = --a +-a + -qa + -q 

with two roots q = and /3(T^ = 1, i.e. q = ^^^^2^. If we study A(/3, A, g) 
as a function of q^ we see that 

—A{l5,X,q) = --A{P,X,q) = ^^{l ^ ^ 



dq^ 2qdq 4 V {l-X + /3^q) 
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Since -^A{/3, A, q) is increasing, is a convex function of and at q = 
we have that 

|,i(ftA.,-%.„ = f(l-^)=f(l 

Due to the convexity of A{q^), the minimum is achieved at g = for < 1 
and at g > for /3a > 1- □ 

By combining the information of Theorem H] and Proposition [3] we have the 
proof of the fohowing main result. 

Theorem 5. The replica symmetric approximation for the free energy is well 
defined by the following variational principle: 

A^^{/3,X)= inf i(/3,A,g-), (49) 

'?6^'/3,a(9) 

where 

A{f3,X,q) = log(a) + l/32ga2 + ^f, (50) 

with a{l3,X,q) defined in (146p . The minimum is achieved at q = for 
/3 < 1 — A and at q = otherwise. Moreover the replica symmet- 

ric approximation is an upper bound for A{(3,X), infact, uniformly in N , 

An{P. X) = -PfNiP, A) < A^'il3, A). (51) 

For < 1 the rephca symmetric free energy reduces to the annealed one, 
that, accordingly with Theorem [3l coincides with the thermodynamic limit 
of the true free energy in such a region. Note that q = is also the 

optimal value for A > 1, infact 1 — A + (3'^q = /3 > such that q G Vp^xio) 
and the RS approximation is well defined. In this case we see that g — )• oo 
when /3 — )• 0. 



5 Fluctuation Theory for the Order Parameter 

This section is dedicated to the study of the fluctuations of the (rescaled and 
centered) order parameter. 

The general idea behind is that critical phenomena arises in presence of 
a divergence of the fluctuation of the order parameter of the model. As 
critical phenomena are interesting by themselves, this analysis deserve major 
depth. In particular, we want to bound the annealed region, namely where 
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q = limjv-5>oo (^Qi2 N/ ~ checking that the rescaled fluctuations of {qi2,N) 
diverge on the same critical line where the fluctuation of the annealed free 
energy are singular. 

To this task we introduce and define the rescaled and centered overlap 



^12,N = VN{qi2,N - q), (52) 

which, in the thermodynamic limit, converges to a Gaussian random variable, 
whose variance spreads up to infinity as far as the system approaches the 
critical line in the (/?, A) plane. 

Once again the strategy we outline is the one developed for the Sherrington- 
Kirkpatrick model |ll||15|p!6]. It is still based on the evaluation of overlap 
correlations at t = with respect to the Boltzmannfaktor defined in ([37]): 
We can in fact evaluate the thermodynamical observables at t = due to 
the lacking of correlation and then propagate the solution up to i = 1. 
To this task we introduce the following proposition 

Proposition 4. For every smooth function Fg of the overlaps {Qab}Ka<b<s 
among s replicas, 




a=l J 



The proof is here omitted, since it can be easily obtained by long but direct 
calculation. We are interested in considering Fg = ^^21 such that 

I {^2), = ^ m2), - 4 {e,2ch), + 3 ieueuh) ■ (53) 

To understand how (^12)^ behaves we need to tackle even the other two 
correlation functions (^12^13)41 ^-iid (^12^34)4- For the sake of simplicity, let 
us consider t time and put 

^W = (e?2>i, B{t) = {^uCl3)t, C(t) = (6264)t. (54) 

Under the Gaussian Ansatz for the high temperature behavior of ^ab we can 
apply Wick theorem and, by using Proposition (j4|, we can construct the 
following dynamical system for A{t), B[t) and C{t): 

A = /3^{A^ -4B^ + 30"^), 

B = (3'^{2AB-6BC + 6C'^-2B^), 

C = /32(i^C + 452 - IG-BC + IOC^), 
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which can be straightforwardly solved with the initial data 

^(0) = Ec^2(^2)_-2^ 

B{0) = Eu{zf)uj\zi)-(f, 
C{0) = Eio{zi)^-f, 



where 



V '/ 



= -^aj(log(a) + ^/3V2^V2) = PV^a^J, (55) 



= _L (55(logE,e^^"-^^+^^^) + {dj logE^e^^^-'^+^^y) 

= a'' + (5''qa^j\ (56) 

As we are interested in finding criticality, the simplest procedure is approach- 
ing the critical line from the annealed regime, where g = 0. This further 
simplifies the initial conditions as 

74(0) = a^ S(0) = C(0) = 0. (57) 

So the solution of the dynamical system is trivial as -B(t) and C{t) are 
identically zero, while A{t) satisfies 

A = P'^A^, A{Q) = (7^ (58) 

whose solution is 

Remembering that u = (1 — A + /3^(q'))~2, propagating up to f = 1 we finally 
obtain 

(^?2> = ^(1) = il-Xf-P^ ' ^^^^ 

that diverges when P\ = 1, i.e. ^ = 1 — A, in complete agreement with 
Theorem 3. 
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6 Broken Replica Symmetry Bound 



In this section we go beyond the rephca symmetric approximation and we 
show a different bound for the free energy density, that should in principle 
improve the previous one. First of all we introduce the convex space x of 
functional order parameters x, as nondecreasing functions of the auxiliary 
variable q in the [0, 1] interval, i.e. 



and we have to think x{q) as a possible distribution function for the overlap. 
We will consider the case of piecewise constant functional order parameters, 
characterized by an integer K and two sequence of numbers, qQ,qi, . . . ,qK 
and mi, . . . , ttik, satisfying 



such that x[q) = rrii for q G [qi-i,qi]. It is useful to define also niQ = 
and niK+i = 1- The replica symmetric case correspond to K = 2, qi = q, 
mi = and m2 = 1, where overlap selfaverages around q; the case K = 3, 
with two possible value {qi and (72) for the overlap, is the first level of replica 
symmetry breaking, and so on. Now, following the interpolation scheme 
in |13j . we consider a generic piecewise constant x{q) and we introduce the 
interpolating partition function 



where t G [0,1]. Here we have introducted additional independent gaussian 
random variable G A/'(0, 1), a = 1, . . . , K , i = 1, . . . , N . As in the previous 
section we will set C in order to optimize the approximation. Let us call 
the average with respect all the random variables J^, i = 1,. . . ,N and Eq 
the average with respect all the Jij. We denote with E the average with 
respect to all J. Now we define recursively the random variables 



XB x:[0,Q] Bq^x(q) G [0,1] 



(61) 



= qo < qi ■ ■ ■ < qx = Q < mi . . . < mx < 1 



(62) 





(63) 



Zk = Zn; Zk-1 = {^kZ^'') 



...Zo = (EiZ["i)'-i 



(64) 
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where each Za depends only on the external noise Jjj and on the j\ for b < a. 
Finally we define the auxiliary interpolating function 

fN{t; x{q)) = -^Eo log Zo{t; x{q)), (65) 

that is completely averaged out with respect of all the external noises. Notice 
that, at t = 1, we recover the original A]^{I3,X), while, at t = 0, we have a 
solvable one body interaction problem. Thus, we have the possibility to find 
an other sum rule for the free energy 

d 

An{P, A) =ipN{t = 0) + dt-^Nit), (66) 

after calculating the t-derivative of {pN{t,x{q)). For this purpose we need 
some additional definitios. Let us introduce the random variables 

and notice that they depend only on the J^' for b < a and they are normalized, 
E/a = 1. Moreover we consider the t-dependent state oj associated to the 
Boltzmannfaktor defined in (I63p and its replicated il.. A very important rule 
is played by the following states uia, with a = 1,. . . ,K, and its replicated 
Oa, defined as 

UJk{-) = ^^i-); OJa = ^a+l ■ ■ ■'^xifa+l ■ ■ ■ fKl^i-))- (68) 

Finally we define the generalized (.)^ average as 

(.), = E(/i.../A(.)). (69) 

The basic motivation for the introduction of an interpolating function like 
(p{t;x{q)) and the reason cause we tell about a broken replica symmetry 
bound, is the following 

Theorem 6. The t-derivative of (pN{t), defined in (j65p . is given by 



d f3'^ 



/3 



a=l 
K 



2 ^ 

7-'^{'ma+i-ma){{qi2-qaf)^, (70) 



4 

if we set the value C = — ^a=ii^a — Qa-i) = —P'^Q- 



a=l 
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Theorem 7. In the thermodynamic limit, for every functional order param- 
eter x{q) of the type ()62p . the following sum rule holds 

A{f3,X) = ip{0;x) + —^{ma+i -ma)ql 

a=l 



p2 K 



A 1 

V(ma+i - rua) I {{qi2 - <laf)„ dt 

a=l -^0 



(71) 



4 

and, consequently, we have the following bound for the free energy density: 
- /?/(/?, A) = A{f3, A) < 95(0; x) + ^ ^^(m.+i - ma)ql (72) 

a=l 

Clearly, Theorem [7] follows from Theorem |6] by taking into account (j66p and 
noting that the error term, containing overlap's fluctuation around every qa, 
is negative defined. 

Now let us go to Theorem [6l The proof is straightforward and we will indicate 
only the main points. We begin with 



Lemma 4. 



j^ip{t;x) = j^E{fi...fKZ]^'dtZK) 



where 

Z-^dtZK = Z7}dtZM 



N q2 ^ 



«,j=i 1=1 

^ a=l i=l i=l 



Proof. From the definition (j67p we get , for a = . . . K — 1 

Za^dtZa = Ea+lifa+lZ^^^dtZa+l) 

and the proof follows iterating this formula. □ 

Now, using a standard integration by parts on the external noise, we get 

K 

^{Jijfl ■ ■ ■ fKUj{ziZj)) = ^ E(/i . . . dj^Ja ■ ■ ■ fKUj{ziZj)) 

a=l 

+ E{f, . . . fKdj,^uj{ziZj)) 
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K 



E{Jth...fKOo{zi)) = Y,E{fi...djaf,...Mz,)) 

6=1 

+ E{h . . . fKdjauj{z,)) (73) 
that can be completely evaluated using the following 
Lemma 5. For the J -derivative we have 

dj^^u:{z,z,) = I3^iu;{zfz])-u;\z,z,)), (74) 
djauj{zi) = I3\/1 - t^qa - qa~i{uj{zf) - uj'^{zi)), (75) 

dj.Ja = l3]J^mafa{i^a{ziZj) - cba-liziZj)), (76) 

dj^fb = 0, ifb<a, (77) 



dj^fb = /3Vl - Wla - qa-imafa^a{Zi), if b = a, (78) 



5jf /fe = /3\/l - Wla - qa-imbfb{^b{zi) - u)i,_i{zi)), ifb> a(79) 



Proof. Eq. (|74p . (j75p follow from standard calculations, while Eq. ([76 
comes from the definition (j67p and the easily established 



Z^^dj^^Za = Ea+lUa+lZ-^ldj^^Za+l) foT a = 0, . . . , K - 1 



Zj/Oj^^Zk = P\l^uj{z^z^ 



2N 



Za ^dj^^Za = ^Ea+i(/a+i . . . fKUj{ziZj)) = 13^ ^i^a{ziZj) 

In the same way we get Eq. (|78p . (|79p . where we have to remember that 
does not depend on J" if 6 < a. □ 

If we use Lemma |4] and Lemma [U after some straightforward calculations, 
we obtain 

d /32 ^ 

-^V^^it) = —^{ma+i - ma)ql 

a=l 
a=l 

1 ^ 

+ (80) 

i=l 
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and we complete the proof of Theorem [6] setting C = —f!P'Q. 

Now we should find a general expression for 99jv(0;x), as in the following 

Theorem 8. For any choice of the piecewise functional order parameter x, 
the initial condition Lpj\f{0;x) is given by 

VN{0;x) = loga{Q) + f{0,0;x), (81) 

where f{q,y',x) is the solution of the Parisi equation, i.e. the nonlinear 
antiparabolic partial differential equation 

dJ{q,y) + l{f"iq,y)+x{q)f'\q,y))=0, (82) 
with final condition at q = Q 

f{Q,y) = ^'y\Q)y^- (83) 

Proof. Since the Boltzmannfaktor factorizes at f = 0, we have that 
Z;v(0;x) = exp ( ~ ^ zf\ exp U ^ Vga - ga-i ^ J?z)l 

\ 4=1 / \ a=l i=l J 



JJ^(Q)exp ( ^a{Qf{Y.Vqa-qa-iJn 

1=1 \ a=l 

lla{Q)exp (f{Q,Y,V(la-qa-iJn] ■ 

1=1 V o=l / 



(84) 



From the definition (|65p of the interpolating function (pN{t; x), we note that, 
due to the factor, we can evaluate the (I84p on a single site only. The 
a(Q) goes to form the log a{Q) term and what remains is just the solution 
of the Parisi equation, evaluated at y = 0, and propagated from q = Q to 
q = through a series of gaussian integration as in [13] . □ 



Now we can exactly solve equation (l82]) with final condition ([83]) to find 
f{0,0;x) and so ipN(0;x). Infact we give the following 

Lemma 6. For any functional order parameter x £ X , the solution of equa- 
tion i82\) with final condition i83\) . evaluated at y = and q = is given 
by 

/(0,0;x) = -/3V2(Q) /" (85) 

^ ^ 2^ ^^Vo l-P^a^{Q)ffx{q')dq' ^ ' 
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Proof. We look for a solution of (j82p of the form f{q,y) = a{q) + ^b{q)y'^ 
Since / must fulfill final condition (|83p . it has to be a{Q) = and b{Q) - 
If we want f{q,y) to be a solution of (j82|) 



a'Cg) + ^K?) + (^'('Z) + = 0, (86) 



i.e. f{q,y) is a solution of (j82p if a(g) and 6(g) are solutions of the ordinary 
differential equation's system 

a{q) + \b{q) = (87) 
b'{q)+x{q)b\q) = 0, (88) 

with final conditions a{Q) = and b{Q) = (3'^a'^{Q). Integrating equation 
we obtain 

1 1 



u( R2 2in\ I <l')dQ'- (89) 
b{q) P^cr^iQ) Jq 

Putting (|89p into equation 1871 and integrating, we have the proof. □ 

Finally, from the continuity of f{q, y; x) respect to the choice of the functional 
order parameter x (see [13] . [12] ) and noticing that 

— V(ma+i - ma)ql = —Q^ " V / 1^(l)dq, (90) 

^ a=l 4 2 Jo 

and we can use [7] for stating our main result 

Theorem 9. The pressure of the model is defined by the following variational 
principle: 

yl(/3,A) = inf A{(3,X;x), (91) 



with 



1«2 2.^x r dq 



/o 1- (3^a^Q)r x{q')dq' 



i(/3,A;x) = loga(Q) + i/3V(Q) / 

^ JO 
a2 o2 f-Q 



Moreover the infimum is attaiened at the RS functional order parameter x 
0, < q < q^^ , x = 1 elsewhere. 
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Proof. The first part of the theorem is a direct conseguence of all the results 
in this section; so we will focus our attention only on its last part, that is 



A^^(/3,A) < inf i(/3,A;x). 

Let Xs a family of functional order parameter parametrized by e and con- 
sider A(I3, X;x,.). We will find the infimum of A{/3,\;x) imposing that 
■^A{f5, A; a;£)|e=o = for any family x^ passing through xq = x when e = 0. 
Using (p2|) and defining 77(5) = ■^X£{q)\£=o, the infimum is achieved in x 
satisfying 

H R'^ 1 n(n'\ 



q V{q)dq + -/?V*(Q) / dq r]{q) 



2 70 2" Jo ' 'Jo b^q') 



2 70 V 7o b^q' 

where we have defined b{q) = 1 — x{q')dq' . From the arbitrariness 

of r]{q), it has to be 

for every q and consequently 1 — ^p^^^^ =0i i-e-, recalling the definition of 
6(9), ^ ' 

1 - /3V2(Q) / x{q')d<i = (3a\Q), (94) 

that has the solution x = and Q = q^^ , such that j3a'^{q^^) = 1. □ 

So we have completed the RSB scheme, showing that the RSB bound for 
the free energy gives the same result of the RS approssimation. Anyway we 
have not yet proven that the replica symmetric solution is the exact infinite 
volume free energy of the model. That will be the subject of our last section. 



7 The Reverse Bound 

In this section we will show a lower bound for the gaussian pressure by 
using a well known method in statistical mechanics. The idea, coming from 
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the proof of the equivalence between microcanonical and canonical ensemble 
[19| , is to cut the space into spherical shells of thickness rj in such a way the 
integral over the whole space in the partition function is just the sum over 
all the shell; taking just one single shell then, we obtain a lower bound. 
Namely, we fix i? G [0, oo) and define 



such that, 
Z^(/3,A,J) 



qV 



{z G : rVn -ri< \\z\\ < RVn}, 



> 



> 



2 



(27r)f vJs],^Sr^' 
(27r)- 



(3H^iz,J)-^\\z\\^+^\\z\\^ 



dz 



(95) 



V J si Sr^ 



Taking -iE log we get 



^^^(/3,A)>llog(-^ 
(27r) 2 



(96) 

Since we can exchange the limits — )• and N ^ oo (as it is easy to prove), 
taking the infinite volume limit of both sides we obtain 

A) > R)-^ + i^zil^ + log(R) + i, (97) 



where an easy computation show that jr log( 



(27r)^ 



tends to log(i?) + 1/2. 



Now we can take the supremum over R G [0, oo] obtaining 



A9(/3,A)> sup 

RG{0,oo) 



r.^ (A-l)i?2 r 

(/3, R) - ^ + ^ ^ + logR+- 



(98) 



In what follows we will see that the right side of (j98p is just the replica 
symmetric approximation ^fj^ and thus we have just the lower bound we 
need. 
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As it is well known |17)[8][T8], the free energy of the spherical model can be 
expressed as the variational principle 

A'f{P, R=l)= min \ ( + log(l - g) + ^(1 - q^)) , 
qe[o,i] 2 \l-q 2 / 

where the minimum is achieved at q = 0, for /3 < 1, and at q = 1 — oth- 
erwise. Furthermore, it's easy to check (through a change of variable) that, 
in the spherical model, a shift on the radius is equivalent to a temperature 
rescaling, i.e. 



A'f{P,R)=A'f{PR\l) = { ^ , (99) 

First, we note that the function we want to to maximize 

is continuous in G (0, oo), goes to — oo at the interval's extremes and is 
concave in such that it must have a finite unique maximum. It is more 
useful to extremalize in i?^, such that 

^ f{p,R) = r' ^: (loi) 




and 




^ /(/?, i?) = 4^ <! " 7;, ; ; (102) 



Thanks to the concavity of /, for each value of (/3, A), only one critical point 
R^ can exists: if /3 < (1- A), -R^ = A), otherwise R^ = 2/3 + (A- l)//?^ 

and we obtain 

A)>l"^^°^^^"^^ /5<1-A 
^^^''^-l4log(/3) + f + /3>1-A 

with q{/3,X) = ^— jjr— ^- Right side of equation (I103P is exactly the replica 
symmetric approximation of the model. We can put all information we have 
found in the following final 
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Theorem 10. In the thermodynamic limit, the pressure of the gaussian spin 
glass model satysfies the following inequality 



A9i(3,\)<A%siP,\) 



. A9{f3, A) > sup^g(o,oo) [^'^{13, R)-^ + + \ogR+ \ 

Moreover, 



sup 

-R.e(0,oo) 



A'f{P, R) - ^ + ^ + log i? + - 



thus 

Aa{fi,\)=AlsWA)= sup 

i?e(o,oo) 



\sf,o m (A-l)i?2 1 

(/3, i?) - ^ + ^ ^ + \ogR+- 



8 Conclusions and Outlooks 

In this paper we introduced and solved a model of Gaussian spin glass. We 
have shown how to regularize the soft spins in order to tackle a right control 
of the thermodynamic observables and extend the tecniques developed for 
the Sherrington-Kirkpatrick model. 

In this way we have achieved existence of thermodynamic limit of the free 
energy; we have computed the annealed free energy and, both looking at its 
own fluctuations, both looking at the fluctuations of the order parameter, 
we have found its region of validity in the A) plane, so finding the critical 
line of the model. 

Furthermore, we have studied the Replica Symmetric approximation, and, 
by a deeper analysis through the RSB scheme, we have found that it actually 
give the same bound to the free energy of the model of the RS one. By further 
analysis we have shown that RS solution is infact exact. 
This was in a sense aspected, essentially for two reasons: the supposed rela- 
tion with the Hopfield Model and the intimate connection with the Spherical 
Spin Glass [8j[20j^l8]|21). On the first one, that is our main matter of investi- 
gation, and also the reason why we need to introduce this model [3], we have 
already spent some words in the Introduction. About the second, there is 
a clear a priori hint given by concentration of gaussian measure argoument 
that the two models are equivalent, strengthened by the a posteriori fact 
that they share the same structure of the distribution of the overlap (both 
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replica symmetric). This feature is not surprising, and was pointed out also 
in the final step of our proof, in the previous section. The relationship be- 
tween the two can be deepen more, studing model with even more general 
noise. We plan to report soon about this topic. 
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